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Abstract 

We consider the problem of parameter estimation by the observa¬ 
tions of deterministic signal in white gaussian noise. It is supposed that 
the signal has a singularity of cusp-type. The properties of the max¬ 
imum likelihood and bayesian estimators are described in the asymp¬ 
totics of small noise. Special attention is paid to the problem of param¬ 
eter estimation in the situation of misspecification in regularity, i.e.; 
the statistician supposes that the observed signal has this singularity, 
but the real signal is smooth. The rate and the asymptotic distribution 
of the maximum likelihood estimator in this situation are described. 
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1 Introduction 

Gonsider the problem of parameter estimation by the observations = 
(M,0 < t < T) of the signals in White Gaussian Noise (WGN) 

dXt = S(d,t)dt-hedWt, Xg = 0, 0 < t < T. (1) 

Here S (d, t) is a known function (signal), Wt, 0 < f < T is a Wiener process 
and iH E Q = {a, (3) is unknown parameter. 
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We have to estimate the parameter by continuous time observations 
and to describe the properties of estimators in the asymptotics of small noise, 
i.e., the parameter e G (0,1] is known and the asymptotics corresponds to 
£ —y 0 . 

It is known that if the signal S is a smooth function of "d, then 
the maximum likelihood estimator and bayesian estimators are consistent, 
asymptotically normal 

^ W (0, 1 (d)"^) , £-^ - d) ^ AA (0, 1 (d)"^) , 

we have the convergence of all polynomial moments and the both estimators 
are asymptotically efficient [Jj. Here 1(d) is the Fisher information 

rT 

I(d)= / (2) 

Jo 


Here and in the sequel dor means derivation w.r.t. d. If the signal 
5'(d, f) = S'(f —d), where S (t) is a discontinuous function of t, say, has 
a jump at the point f = 0. Then I (d) = oo, the MLE d^ and BE d^ have the 
rate of convergece with different limit distributions; 

£~‘^ ^dg — dj u, ^dg — dj u, 


and asymptotically efficient are bayesian estimators only. Here E (d)^ > 
E (d)^. For the proofs see [S]. 

We are interested by the properties of the MLE dg in the case of observa¬ 
tions o. where the signal S (d, t) has a singularity of the cusp-type, i.e.; at 
the vicinity of the point t = d it has the representation S (d, f) ~ a |t — d|'^, 
where n G (0, |). Note that for these values of k we have I (d) = oo. 

The problem of parameter estimation for cusp-type singular density func¬ 
tion by i.i.d. observations was considered in [10]. It was shown that the MLE 
d„ has limit distribution with the rate 
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77,2k+i 



t). 


The exhaustive study of singular estimation problems for i.i.d. observations 
including cusp-type singularity can be found in [B]. For stochastic processes 
observed in continuous time the similar problems were considered in [2j for 
inhomogeneous Poisson processes and in |3] for ergodic diffusion processes. 
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This work is devoted to two problems. The first one is to describe the 
asymptotics of the MLE and BE in the case of signal with cusp-type singu¬ 
larity. It is shown that 

I 

where ^ and ^ are two different r.v.’s, E((^^) > E(^^). The second problem is 
to study the properties of the MLE, when the signal supposed by the statis¬ 
tician (theoretical) has cusp-type singularity, but the real signal is smooth 
(regular). We show that 

£- 3 =^ — -dj (. 

Here '& is the value of 6 which minimizes the corresponding Kulback-Leibler 
distance. The proofs are carried out following two general results by Ibragi¬ 
mov and Khasminskii (Theorems 1.10.1 and 1.10.2 in jB]), i.e., we verify the 
conditions of these theorems for our model of observations. 

Note that the similar problem of misspecification was considered in the 
work [1], where the signal chosen by the statistician (theoretical model) has 
discontinuity, but the real signal is smooth. It is shown that 

— "dj t). 

We discuss as well the problem of estimation k. The presented work is a 
contuniation of the study |I]. 


2 Main result 

Let us consider the problem of parameter estimation by the observations 
(in continuous time) of the deterministic signal in the presence of White 
Gaussian Noise (WGN) of small intensity 

dW =-5(4,f)df + edIW, Xo = 0, 0 < f < T, (3) 

where the unknown parametr do G 0 = (a,/?). We are interested by the 
behavior of the estimators of this parameter in the asymptotics of small 
noise, i.e., as e —)■ 0. 

Suppose that the signal S (d, t) has cusp-type singularity 
S (d, t) = a \ t — 0\'^ h {t, d), 
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where Q<a<'d<l3<T and k G (0, i). The function h is continu¬ 
ously differentiable w.r.t. -d and has bounded derivative. 


The likelihood ratio function is 


V (d, X^) = exp 




S (d, t)^ dt 


(see 0 ) and the MLE d^ is defined by the equation 

vUe^xA =supy (d,X^) 

^ i?ee 


d G 0 


(4) 


Suppose that d is a random variable with continuous, positive density 
function p (d), a < d < /3. The bayesian estimator (BE) dg with quadratic 
loss function is 


- S^0p{0)V(0,X'^)A0 

’ s1pWV{0,x^)A0' 


(5) 


We are interested by the properties of the estimators d^ and d^ in the 
asymptotics e 0. 

Note that the Fisher information is not finite and we have a singular 
problem of parameter estimation. Introduce the Hurst parameter if = k -|- 4 
and double-side fractional Brownian motion (fBm) {u) ,u ^ R. Recall, 
that (u) = 0 and 


En-'» («) ivr (i.) = - 


rH 


1 r 


I |2ir , I i2H I i2H 

\u\ -l- n — \u — v\ 


, u,v E R. (6) 


Introduce two random variables ^ and ^ by the relations 

/ uZ {u) du 


Z(0 = supZ(n), r , 

udR J Z {u) du 


where the process 


r2 


Z{u) = exp <1 TIE" {u) - — \u\ 


u E R. 


Here 


(7) 


T^ = / [|n — ll'^ — \v\'^]^ dn. 
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Introduce as well the process 


Z° (v) = exp <; w (v) - -^\v 


2H 


V e R 


and the corresponding random variables and by the relations 

/ vZ° (v) dn 


Z(^o) =supZ°(n), <^o= 

veR J Z°(v)dv 


Note that 


i = — 

^ -r- ’ 

i H 


1= — 
^ -r- ■ 

i H 


( 8 ) 


The proof of ([8]) follows immediately from the change of variables u = Thv 
in Z (u). 


Adymptotically efficient estimators we define with the help of the following 
lower bound. For all do € 0 and all estimators we have the relation 

limlim sup Id^ - d|^ > (9) 

<5^0 e^O |i?-i?o|<<5 

Therefore we call the estimator d* asymptotically efficient if for all do G 0 
we have the equality 

limlim sup |d* — d|^ = E^Q(f^). (10) 

<5-i.O £->0 


The proof of this bound follows from the general results presented in [B]. We 
can recall here the scetch of the proof supposing that the properties of the 
bayesian estimators for this model are already proved (see theorem [T] below). 
Introduce a continuous positive density function (g (d), do — d < d < do + d). 
Then we can write 


sup E^ |de — d|^ > 
|)9-i?o|<<5 


> 


r'&o-\-S 

I '^Q—S 

p'do-\-6 
^ i^o—S 


E^ [dg — d|^ q (d) dd 


E, 


dg,£ - d 


q (d) dd. 


where we denoted dg^^ the bayesian estimator in the case of the density a 
priory g(-). As we have the convergence of moments of BE we obtain the 
limit 


lim sup £ |d* — d|^ > lime 

e-j.0 |i?-i?o|<<5 


-2/H 


£—^0 


r'&O+S 


/ E^ 

dg,£ - d 




q (d) dd 


r‘'i?o+<5 


E^leTg (d) dd = E(f^) = r-«E(|2) 
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for all 6 > 0. Remind that does not depend on This proves the 

lower bound dH])- 

Theorem 1 The MLE and BE are consistent, have different limit distribu¬ 
tions 

I, I, 

the polynomial moments converge : for any p > 0 


lim 

£—^0 


ds — d 

T 

EH 


P 


E^ier, 


lim E^ 

£—^0 


de — d 

T 

EH 


P 




and the BE are asymptotically efficient. 

Proof. To prove this theorem we check the conditions of the general Theorem 
1.10.1 in [B]. Let us put ip^ = e^^^ and introduce the normalized likelihood 
ratio 


Ze{u) 


V (do + PeU, x'^) 
V{do,X^) 


uelJe = (e (o -do) .e (/3 - 790)) . 


The verification of these conditions we do with the help of the lemmas pre¬ 
sented below. 


Lemma 1 ITe have the convergence of finite-dimensional distributions of 
Ze (•)•' Ui,... ,Uk and any k = 1,2,... 


(mi) ,...,Z^ (ufc)) ^ {Z (ui) ,...,Z (ufc)) • (11) 


This convergence is uniforme in id on compacts IK C 0. 
Proof. We can write {u > 0) 

In Zg (u) = 4 f [“S' {do + (PeU, t) - S {do, t)] dX* 


2^2 


[S' {do + ipeU, tf - S {do, tf] dt 


1 

E 


[S (^9o + TeU, t)- S {do, t)] dlW 


2^2 


[S (t9o + TsU, t)- S {do, t)f dt. 
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For the last integral we have 

rT 


[5 (h'o + ‘feU, t) - S (^?o, t)] dt 


'0 


a\t — do — — a \ t — do\^ + h {do + ^PeU, t) — h t)]^ dt 


'0 


rT-'do r 


'-i?o 


a |t — ~ ^ l^r + ^eU h{d, t — do) 


dt, 


where we changed the variable and used Taylor expansion for the function 
h {d, t). 

Let us put t = p^s, then we obtain 

rT 

/ [S {do + PsU,t) - S {do,t)]^ dt 


= 






a |s — u\'^ — a |s|'^ + p^ '^'U h{d, sp^ — do) 


l2 


dt 


= 


j 4>e 


/_2a 

‘•Pe 



Hence 


-p [s {do + PeU, t)- S {do, t)]^ dt 


^2p2K+l 


s — uj^ — ds (1 + o (1)) 






I 

_ tD- 

<Peu 


n - 1|^ - \v\^f dn (1 + o (1)) —^ F" , (12) 


2 I ,|2k+1 


where we put s = vu. 

The similar calculations for the stochastic integral provide us the relations 

1 

e 


[5 (do + PsU, t)- S {do, t)] dWt 


= a 


Ve 


s — u\^ — Isl'^] dlF (s) (1 + 0 (1)) 


[|s — u\^ — |s|^] dlF (s) ~ M ^0, 




7 



Here W {v) ,u & R \s two-sided Wiener process 


W{v) = 


W+ (v), if n > 0, 


W_ (-v), ifv<0, 

where (v), (n), n > 0 are two independent Wiener processes. 

Let us denote 


(u) = T-^ 


Is-nl'^- l^r] dW(s) 


and verify ([6]). We use below the equality ab = ^ [a^ + — {a — 6)^] 


EW^ (u) (v) 


H 


2 

1 

2 L 


E {W^ {u)Y + E {W^ {v)Y - E {W^ (n) - (n))' 


I |2H , I <2H I i2H 

\u\ + m — \u — v\ 


because 


E {W^ (n) - (n)) =T-^ [|s - u\^ - \s - v\Y ds 


= r 


-2 


\r — (u — nir — kri^ dr = In — n 


|2k+1 


Hence (n), m G i? is a double-sided fBni. 

Therefore we proved the convergence of one-dimensional distributions. 
The multi-dimensional case is treated by a similar way. We have to verify 
the convergence 


k k 

^A,TnZ,(n,) Xj In Z [uj). 

i=i i=i 

for an arbitrary vectors (Ai,..., A^) and {ui,..., Uk). 
Let us denote 

Jo 

We have the following elementary estimate 
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Lemma 2 There exists a constant ^ > 0 such that 


(13) 

Proof. Note that for any u > 0 

m{p) = inf $ (- 1 ?,'(^o) > 0 - 

|l? — 1 ? 0 |>!^ 

Indeed, if for some i/ > 0 we have m {v) = 0, then there exists "di 7 ^ 'do snch 
that for all t G [0,T] 

a |t — -dil^ + h ("di, t) = a\t — 'do|^ + h (-do, t) 
and the fnnction 

/i ('di, t) = a\t — "dol^ — a |t — -dil^ + /i (-do, t) 
has no continnons bonnded derivativ on -di. Hence for I'd — 'do| > r' 

(d, -do) >m{u)>m {u) 7 -- 

Ip ~ c(\ 


Fnrther, for the valnes 


'd — 'd 


< z/ for snfficiently small u we have 


^>(d,4) = l^-^?ol'"'r2(i + o(i)). 

Therefore for snfficiently small u we can write 

d)(d,4)>^r2|d-4l'^. 

Taking 


fj, = min 


/ m{h') r^\ 

V|/3-a|^^’^; 


we obtain flT^ . 

This estimate allows ns to verify the bonndness of all moments of the 
psendo likelihood ratio process. 

Lemma 3 There exist a constant c > 0 such that 



( 14 ) 
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Proof. We have 


-<h(^9o + ^eU,'&o) \ < exp 


h I \2H 

■— \u\ 


(tt )2 = exp 
where we used (HI. 

Lemma 4 For any N > 0 and \ui\ < N, \u 2 \ < N we have the estimate 


E 


1?0 


Z} {U 2 ) - Zi {ui) <C{l + N)\u2-Ui 


\2H 


with some constant C > 0. 
Proof. We can write 


E, 


1?0 


(U 2 ) - (Ml) 


= 2 1 - E, 




(M 2 ) 

Ze (mi) 


= 2 1^1 - exp (^0 + FsU 2 , "do + FsUi) 


(15) 


= ^ y [a |t - i9o - V^eMaH - a |t - i^o - FeUil'^ 

+h {do + (PeU2, t) -h {do + ipeUi, t)]^ dt 


< 


2 e 2 


[a\t-do- (PeU2r - a\t-do- ifeUi\'^] dt 
+ ^ / [h{do + (PeU 2 , t)-h {do + (PeUl, t)f dt 


'0 


< 


^ 2 k +1 
Fe t ^2 


252 


|U2 - Ml 


|2k+1 , Fe 


+ 


2^2 


h{d, t)^dt {u2 — UiY 


'0 


< C* (1 + |m 2 — Mif '^) |m2 — MiP"*"^ < (7 (1 + A^) |U 2 — Ml 


i 2 jr 


Note that 2fi: < 1 and 2H > 1. The properties of the likelihood ratio 
fllip . fll4p and fll5p correspond to the conditions of the Theorems 1.10.1 and 
1.10.2 in |6| and therefore the MLE de and BE ds have all mentioned in the 
Theorem [T] properties. 


Remark 2.1. More detailed analysis shows that if the signal has several 
points of cusp, say 

L 

S{^,t) = '^ai\t -dY‘ , 

i=i 


10 









where ki G (0, |), then the result of the Theorem [T] holds with 

K, = min Ki. 

1<1<L 

The proof is similar to the given proof of the Theorem [1] 

Remark 2.2. It is possible to study the properties of the estimators "ds 
and dg in the case of multiple different singularities. For example, suppose 
that 


L 

S = '^ai\t- dzi'"' 

i=i 


where'd = ("di,..., G ©• Here 0 = (ai, /5i) x • • • x {aL, Pl), 0 < ai < 
j3i <T and /?; < a^+i, / = 1,..., L - 1. 

Then the limit for the normalized likelihood ratio 


(^1 1 ■ ■ ■ 1 Ul ) 


V ... ,i9l + e^LUL,X'^'j 


is the process 


L 

Z {ui,... ,ul) = WZi{ui), ui e R, 

i=i 


where 

Zi (ui) = exp (ui) - y I , uie R, 

and the constants 

/ OO 

[|n — 1|'^* — \v\^‘]^ dn. 

■OO 

The fBm processes (■) j are independent. The MLE = 

^■di^g,..., "di^e j and BE -dg = ..., '&L,e^ are dehned by the same rela¬ 

tions (jH), ([5]) and have different limit distributions. In particularly, for the 
MLE we have the convergence 


e - 1^1 ^L,e - '&L 


1 


1 
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The limit random variables (• • •, ) are defined by the equations 


= supZi (m) , / = 

U 

and are independent. Of course, the bayesian estimators have the same rate 
and the asymptotic distribution is 




1 


J 



Here the random variables 




/ uiZi (ui) dui 

f Zi(ui)dui 


1 = 1,...,L 


are as well asymptotically independent. 


3 Misspecification 

We are intrerested by the following problem of misspecification. Suppose 
that the model of observations choosen by the statistician [theoretical model) 

is 

dXt = M{d,t)dt + edWt, Xq = 0, 0 < f < T. 

The signal M (d, t) is supposed to be 

M (d, t) = a\t — , 0 < t < T, 

where k G (0, |) and d eQ = [a <d</3). As before we suppose that 
0 < a < (d < T. 

The observed process (real model) is 

dXt = S{do,t)dt + edWt, Xq = 0 , 0 < t < T, (16) 

where "do G 0 is the true value and the function S (d, •) G L 2 (0,T) is suffi¬ 
ciently smooth. 

The likelihood ratio function (misspecified) is 

H (d,X'^) = exp y M {'d,t) dXt - j M (d, dtj , d G 0 
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where we have to substitute the observations from the equation ([TB]) . There¬ 
fore the (pseudo) MLE is defined by the equation 

v(S,,X^)=snpV{i^,X^). (17) 


To see the limit of the MLE we write the likelihood ratio as follows 


In y X^) 

= e [ M{^,t)dWt-l [ [M tf - 2M (^?, t) S (4, t)] df 
Jo 2 Jq 

= e / M id, t) dW, - i ||Af (tf,.) - S (tfo, Olt + 1 IIS (tf„, .)||^ 

where we denoted as H-H the L 2 (0,T) norm. It is easy to verify the conver¬ 
gence 

sup 
i?ee 

Suppose that the equation 


ir=lnL(tf..Yq--||A'/(tf,-)-S(tf„, 


l' + 5lis(tf„, 


^ 0 . 


inf||M(^,-)-^(4,-)ll 




has a unique solution -d G 0. 

Then we obtain as usual in such situations that the MLEconverges to 
the value d, which minimizes the Kullback-Leibler distance. 

It is interesting to note that in general case d 7 ^ do but sometimes d = do 
and we consider the conditions of the consistency in such situations. The 
most interesting for us is the question of the rate of convergence of the MLE 
to the true value. 


Introduce the function 

$(d, d) = ||M(d, •) - 5 (do, Oil' - l|M(d, 0-5 (do, 0 IP 
and the conditions of regularity: 

Condition M. 

1. The parameter k G (O, . 

2. The function S (do,t) for all do G 0 is two times continuously differ¬ 
entiable w.r.t. t G [0,T]. 
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3. The function i3) for all iHq G 0 has a unique minimum at the point 
"& = 'd ('(?o)- 


4 . It’s second derivative 




^^2 


> 0 




for all -do e 0. 
Let us denote 


Z (u) = exp < aW^ (u) 




u > , u E R 


Z° (u) = exp “ y j ’ ^ ^ ^ 

and define the random variables (4, Co by the relations 

Z(C) = supZ(n), Z'’(Co) = supZ° (n). 

U V 

Note that 

c = 


2a 




Co. 


(18) 


To verify (ITS]) we change the variables u = rv with r = (2a) 7 ('d) 2^-1 

and write 


alT" (u) 


2 10)r\2 


-u^ = aW^ (rv) 


= arH 


i_ ( {rv) 7 ('d)r^ h 


f H 4a 


n" 1 = ar» 1 {v) —— 


where the fBm {v) = r hW^ {rv). 

Theorem 2 Let the conditions M be fulfilled, then the estimator con¬ 
verges to the value d, has the limit distribution 


■dg — -d 
2 

^ 3 —2k 


c, 


and for any p > 0 


lim 

£—^0 


dr — D 


2 

£-3-2k 


VH 


= E,< 


2 a 

7(d) 


E 


(19) 


( 20 ) 
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Proof. Introduce the normalized pseudo-likelihood ratio process 




V{^ + ip,u, 


V 


M e Ue = 


a — '&) {l3 — 




V’e 


where ^ 0 will be dehned later and denote ■(?„ = "d -1- (feU. Below we 
use the same arguments as that of the preceding section in similar situation 
{u > 0) 


f'T ^ 


In Ze (u) = — 


’0 

1 


M I'd + ifeU, t) — M I'd, t 


dXt 


rT r 


1 

£ 


M (d+ t) -M[d,t 
dWt 


dt 



P 


K- 

L 

a t — d„ — a 

t — d 




P 



L 

a\t — 'dul'^ — a 

t — 'd 

-f h{du,t) - h{t},t) 


1 

a |t — -|- a 


t — 'd 


-2S{do,t) 


dt 


a<fe 


r ‘Pe 

[ s — — s 

l-X 



2£2 




Let us study the function d) for a fixed -u > 0 as (/?£—)■ 0. We have 


r-T ^ 


^{^,d)= [M{^,t)-S{do,t)fdt 


M{d,t) - S {'do,t) 


dt 

'0 Jo ' ' 

f [a |s|^ — S' ('do) ■s + d)]^ dt — f M('d, t) — S' (-do, t)l dt 

l-'d Jo L 


and 


$;(d, d) = [a |dr - 5 (do, 0)]' - [a |T - dj" - ^ (do, Tf 

/ T-'d 

[a l^r - s (do, s + d)] S' (do, s + d) ds. 

-1? 

Recall that as d G 0 is the point of minimum of the function $(d, d), d G 0 
we have the equalities 


$(d,d) = 0, $;(d,d) = 0. 
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Let us write the Taylor expansion 


{}) = <l>(^?, 'd) + ^9) (1 + 0 (1)) 

uP‘v?' 

= ^4S(i),tf)(l+o(l)) 

and study the difference 

d) - d) = [a ^ (do, 0)]' - [a|dr - ^ (do, 0)]' 

+ [a\T -dr-S (do, T)] ^-[alT-'&X-S (do, Tf 

l‘T—'du 

-2 [a |s|'" - S (do, s + d„)] S' (do, s + d„) ds 

J-'du 

+ 2 J a |s|^ — S'^do, s + dj S''^do, s + dj ds. 

We have the estimates 

[a|d„r-,S(do,0)]'- [a|dr-,S(do,0)]' 

= a |d + — |d|'' a|d + + a|d|'^ — 2S'(do, 0) 

= a [|d + - |d|H [a|d + + a\X - 2^ (4, 0) 

2^ /t" r ^ n 

= ^-— aid]''- S'(do, 0) ipeU + 0{ipX) 

L J 

and similary 

a T-'d'^ -S (do, T)j ^ - \a\T - d - - S (do, T)j ^ 

= iXk- Nr - >?r - s (4. T)] ^,u +o i^y) 

\I — dN“'^ L 

hecanse 


|d + (/jguN 





i^r+ o yy) 
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Further, we can write 


a |s|^ — S'(<s + -(9 ) S''(-(^o, s + -(9 ) ds 


I [a |s|'' - S (^9o, -s + S' (do, s + ds 

-'&U 

t — d [S' (do, t + (psu) — S' (do, t)] dt 


[S (do, t + (fsu) S'(t + (feu) - S' (do, t) S' (do, t)] dt 


—/*T—I? 


— T^u JT — ^, 


a Isl" — S' (do, s + d„)] S' (do, s + d„) ds. 


Therefore we obtain the relations 


t — d [S'' (do, t + (peu) — S' (do, t)] dt 

pT ^ ^ 

= / t —d S'" (do, t) dt (/?£« +O ((/jg-u^) , 

Jo 

[S' (do, t + ip^u) S' (do, t + (/?£«) - S' (do, t) S" (do, t)] dt 

= sf tf] I dt ifeU + O (vj^n^) , 


[a IsT - S' (do, s + d„)] S' (do, s + d„) ds 

= a d -S'(do,0) S"(do,0) (p^u + O {(plu^) , 

S 

[a |s|'' - S' (do, s + d^,)] S' (do, s + du) ds 

u 

= 'a T-d^-S (do, T)1 F' (do, T) p,u + O {^y) 


All these together allows us to write 
$[j(d„,d) 2aK r , 2aK 


PeU dl- 


a|dr - ^ (do, 0)1 + Lt - dr - A (do, T) 

L ^ \i — dr^'^ L -I 


+ [a |dP - A (do, 0)] A' (do, 0) + [a |r - dj" - A (do, T)] S' (do, T) 

r'^ i ^ K r'^ 

+ 2 / t-d S'"(do,t)dt+ / [S'(do, t)^]J dt + O ((/?£«). (21) 
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Hence we obtain the following expression for second derivative 


d) = lim 
>-0 




iPeU 


2aK ■ 


+ a 


a|dr-5(do,0) 


+ 


2aK 


|T-d|i- 


a\T - - S {^o,T) 


S{A,0) ^'( 4 , 0 ) + 


T-d 


S{A,T) S'{i}o,T) 


t — d 




( 22 ) 


Now the log-likelihood ratio has the representation 


K+i 


In (n) = 




(«) (1 + 0(1)) - ^s;(d,d) (1 + 0 ( 1 )) 




K-\- 7 




U 


^ aW^ (u) (1 + o (1)) - (1 + o (1)) 


Therefore if we put 




= 1 , 


Lf^ = £3-2k , 


Ze (u) = {u 


4k-2 
£ ‘6 — ' 2 k 


then we obtain the convergence of hnite-diniensional distributions 
Z^ (ui ),..., Z^ (uk)] ^ (z (ui ),..., Z (uk) 


for any k = 1,2,.... 

Using the same arguments as in the proofs of the lemmae [2111] we obtain 
the relations 


$ j > — -d 

(^) < 


E, 




Zi {U 2 ) - Zi (-ui) < C {1 + N) \u2 - till 


Therefore once more the asymptotic properties of the pseudo-MLE -dg follow 
from the general result by Ibragimov and Kasminskii [B], Theorem 1.10.1. 
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Let us remind how the properties of are related with the convergence 
of the stochastic processes (•) can write 


'^0 I ^ 1 = P^o ( < ^ + 


= P^o sup V ("d, X^) > sup V (d, X'^) 

„ , rp.A'p rp.A'p 

^ Ptfo < sup -^ > sup - Y~. - 

i?<i?+ipeX 1/ ( d, X^ ) i?>i?+ipea: V ( "d, X'^ 


Pl?0 ] 

sup 

Zs 

(u) > sup 

Ze 

(u) 

1 

ln<a;,neUe 


U>X,u£Ve 



Pi?o j 

sup 

Ze 

(u) > sup 

Ze 

(u) 

1 

1 u<x,u£Ve 


U>X^u£Ve 




where Us = jg dehned by the relation 


‘fe 


(it^) = sup Ze (u). 

neUe 


Now from the convergence (•) ^ Z {■) we obtain 


-^0 ^ sup Z^ {u) > sup 

^u<x,u£Ve u>x,u£\Je 


Zsiu) 


—> P^o < sup Z (u) > sup Z (u) > = P^Q (C < 3; 

f u<x u>x J ^ 

(see the details in [B], Theorem 1.10.1). 

Remark 3.1. Of course, it is possible to considere slightly more general 
problem with the signal 

S (19, t) = ajt-i9j'' Ip<,?} + 6 |f - 'dl'' ]Ip>^} + h (i9, t ), 

where 6 > 0 and h (i9, t) is some smooth function of i9 and t. As usual in 
singular estimation problems the limit likelihood ratio Z (■) does not depend 
on the function h (•, •) and the properties of the pseudo-MLE are quite close 
to that of the presented in the Theorem [2l 

There are another interesting problems of misspecihcation cusp vs discon¬ 
tinuous and discontinuous vs cusp, which can be illustrated by the following 
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example. Suppose that we have two signals 




where k G (0, |) and 


-a\t - + a |t - d|'" 


M (-d, t) = a sgn (t — d). 

One problem is the estimation of the parameter ■d in the situation, where 
S ('do,t) is the observed signal and M is supposed (theoretical) signal. 
The second problem corresponds to the situation where the observed signal is 
M ("do, t) and the theoretical signal is S (d, t). The both problems are studied 
in the forthcomming paper. 


4 Estimation of the parameter 

Let us consider the problem of estimation of the parameter k G (/c, K) , 0 < 
k < K < oohy observations 

dXt = a\t - &t + edWu Xq = 0 , 0 < f < T, 

where a > 0 and p G (0, T) are some known parameters. The likelihood-ratio 
function is 


V (k, X^) = exp <1 / -^- dXt 


a? \t — p\ 
2^2 


2k 


-dt 


K G {k,K) 


and the MLE is solution of the equation 

V = sup V (k,X'^^ 

K€(k,K) 

This is regular prolem with the Fisher information 


I (k) = m / \t — p\'^ (In \t — p\) df > 0. 

Jo 


It is easy to see that the identihcation condition 

inf [ {\t- pI^'^-\ t-prYdt>0. 

\k-ko\>u Jq 
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is fulfilled for any kq and any i/ > 0. 
Therefore the asymptotic normality 


Ke - Ko 


AA(0,I(«o)-') 


follows from the general theorem devoted to the parameter estimation in 
regular families (see Theorem 3.1.1 in |6]). Just note that the normalized 
likelihood ratio 


{v) = 


V (ko + ev, X'^) 


V(ko,X^) 
converges to the process 


veY,= 


k — Ko K — Ko 


u 


Z* (n) = exp uA ——1 (ko) , n G i?, 


(24) 


where A ~ A/" (0,1 (kq)) 


It is interesting as well to consider the problem of two-dimensional pa¬ 
rameter "d = (p, k) estimation. The likelihood-ratio function is 


V (p, K, = exp 


a\t — pf 


fT ^2 


■dA, 


\t — p| 


2k 


-dt 


G 0, 


where Q = {a, j3) x {k, K), 0 < a < /3 < T. 

It can be shown that the normalized likelihood ratio 


(n, v) = 


V ^po esu, Ko + en, A^j 
V{po,Ko,X^) 


converges to the random process 


Z{u,v) = Z{u) Z* (n) 


where the processes Z (■) and Z* (•) are defined by the expressions ([7j) and 
(1241) . Note that the fBm (■) and the random variable A are independent. 

The MLE -de = {p£,ks) is consistent and it’s components pe and are 
asymptotically independent and have limit distributions with different nor¬ 
malizing rates 


Pe - PO 





~AA(0,I(«:o)-'). 
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The proof follows the mains steps of the proof of the Theorem 1 is cumber¬ 
some and do not presented here. 
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